Short Text Embedding Autoencoders With Attention-Based Neighborhood Preservation
نویسندگان
چکیده
منابع مشابه
Challenges with Variational Autoencoders for Text
We study variational autoencoders for text data to build a generative model that can be used to conditionally generate text. We introduce a mutual information criterion to encourage the model to put semantic information into the latent representation, and compare its efficacy with other tricks explored in literature such as KL divergence cost annealing and word dropout. We compare the log-likel...
متن کاملTranslations on graphs with neighborhood preservation
In the field of graph signal processing, defining translation operators is crucial to allow certain tasks, including moving a filter to a specific location or tracking objects. In order to successfully generalize translation-based tools existing in the time domain, graph based translations should offer multiple properties: a) the translation of a localized kernel should be localized, b) in regu...
متن کاملLossless data embedding with file size preservation
In lossless watermarking, it is possible to completely remove the embedding distortion from the watermarked image and recover an exact copy of the original unwatermarked image. Lossless watermarks found applications in fragile authentication, integrity protection, and metadata embedding. It is especially important for medical and military images. Frequently, lossless embedding disproportionably...
متن کاملConstraint Sparse Neighborhood Preserving Embedding
Neighborhood Preserving Embedding (NPE) and extensions of NPE are hot research topics of data mining at present. An algorithm called Constraint Sparse Neighborhood Preserving Embedding (CSNPE) for dimensionality reduction is proposed in the paper. The algorithm firstly creates the local sparse reconstructive relation information of samples; then, exacts the pairwise constrain information of sam...
متن کاملLearning Text Pair Similarity with Context-sensitive Autoencoders
We present a pairwise context-sensitive Autoencoder for computing text pair similarity. Our model encodes input text into context-sensitive representations and uses them to compute similarity between text pairs. Our model outperforms the state-of-the-art models in two semantic retrieval tasks and a contextual word similarity task. For retrieval, our unsupervised approach that merely ranks input...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: IEEE Access
سال: 2020
ISSN: 2169-3536
DOI: 10.1109/access.2020.3042778